منابع مشابه
Evolutionary Crowdsourcing Approach for Quality Control
Crowdsourcing is widely used for solving simple tasks (e.g. tagging images) and recently, some researchers [9][10] propose new crowdsourcing models to handle complex tasks (e.g. articling writing). In both type of crowdsourcing models (for simple and complex tasks), voting is a technique that is widely used for quality control [9]. However, we argue that voting is actually a technique that sele...
متن کاملCrowdsourcing Quality Control for Item Ordering Tasks
One of the biggest challenges in crowdsourcing is quality control which is to expect high quality results from crowd workers who are not necessarily very capable nor motivated. In this paper, we consider item ordering questions, where workers are asked to arrange multiple items in the correct order. We propose a probabilistic generative model of crowd answers by extending a distance-based order...
متن کاملOn Quality Control and Machine Learning in Crowdsourcing
The advent of crowdsourcing has created a variety of new opportunities for improving upon traditional methods of data collection and annotation. This in turn has created intriguing newopportunities for data-driven machine learning (ML). Convenient access to crowd workers for simple data collection has further generalized to leveraging more arbitrary crowd-based human computation (von Ahn 2005) ...
متن کاملA Transcription Task for Crowdsourcing with Automatic Quality Control
In this paper, we propose a two-stage transcription task design for crowdsourcing with an automatic quality control mechanism embedded in each stage. For the first stage, a support vector machine (SVM) classifier is utilized to quickly filter poor quality transcripts based on acoustic cues and language patterns in the transcript. In the second stage, word level confidence scores are used to est...
متن کاملCrowdsourcing Linked Data Quality Assessment
In this paper we look into the use of crowdsourcing as a means to handle Linked Data quality problems that are challenging to be solved automatically. We analyzed the most common errors encountered in Linked Data sources and classified them according to the extent to which they are likely to be amenable to a specific form of crowdsourcing. Based on this analysis, we implemented a quality assess...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: ACM Computing Surveys
سال: 2018
ISSN: 0360-0300,1557-7341
DOI: 10.1145/3148148